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Abstract 



We prove that the First Fit bin packing algorithm is stable under the input distribution U{k — 2, k] 
for all k > 3, settling an open question from the recent survey by Coffman, Garey, and Johnson [3]. Our 
proof generalizes the multi-dimensional Markov chain analysis used by Kenyon, Rabani, and Sinclair to 
prove that Best Fit is also stable under these distributions [11]. Our proof is motivated by an analysis of 
Random Fit, a new simple packing algorithm related to First Fit, that is interesting in its own right. We 
show that Random Fit is stable under the input distributions U{k — 2, k], as well as present worst-case 
bounds and some results on distributions U{k — 1, k] and U [k, k] for Random Fit. 



1 Introduction 

In the one-dimensional bin packing problem, one is given a sequence ai, . . . ,a„ G (0, 1] of items to pack 
into bins of unit capacity so as to minimize the number of bins used. A great deal of literature has focused 
on this problem, perhaps because, as Coffman, Garey, and Johnson [3] observe in their recent survey on bin 
packing, "The classical one-dimensional bin packing problem has long served as a proving ground for new 
approaches to the analysis of approximation algorithms." For example, recently the study of Best Fit bin 
packing under discrete uniform distributions has led to a novel analysis technique, based on the theory of 
multi-dimensional Markov chains. In this paper we extend this approach to analyze First Fit and a new bin 
packing algorithm, called Random Fit, under discrete uniform distributions. 

First Fit and Best Fit are two classical algorithms for online bin packing. With First Fit, the bins are indexed 
in increasing order of their creation. Each item is sequentially placed into the lowest indexed bin into which 
it will fit, or into a empty bin if no such bin is available. With the Best Fit algorithm, each incoming item 
is placed into the non-empty bin with smallest residual capacity that can contain it; if no such bin exists, 
the item is placed in an empty bin. The performance of First Fit and Best Fit in the worst case and uniform 
average case has been settled for quite some time. In the worst case, the number of bins used by any of these 
algorithms is at most |^ times the optimum number of bins, as shown by Johnson et al. [10]. When item 
sizes are generated by t/(0, 1), the continuous uniform distribution on (0, 1], then the performance measure 
of interest is the expected waste, which is the difference between the number of bins used and the total size of 
the items packed so far. Shor [16] showed that the expected waste created by First Fit is 0(?i^/^). Shor [16] 
and Leighton and Shor [13] proved that Best Fit does better, generating expected waste ©(v'n log^^"* n). 

Because of these tight bounds, research on First Fit and Best Fit is now focused on analyzing expected waste 
when item sizes are generated by discrete uniform distributions. A discrete uniform distribution, denoted 
by U [j, k}, I < j < k, is one where item sizes are chosen uniformly from the set [l/k,2/k, . . . , j/k}. For 
U{k, k}, k > I, First Fit and Best Fit achieve expected waste @(Vnk) and 0(^/nlogk), respectively, (see 
Coffman et al. [2]). Similar bounds hold for U[k — l,k]. Of particular interest are distributions for which 
the algorithms are stable. We say that a algorithm is stable under a distribution if the expected waste remains 
bounded (that is, 0(1)), even as the number of items n goes to infinity. Coffman et al. [2] proved that First 
Fit is stable under U{j, k}, when k > j^, and Best Fit is stable under U{j, k}, when k > j{j + 3)/2. 
Later, Coffinan et al. [4] introduced a novel method for proving the stability (and instability) of bin packing 
algorithms based on multi-dimensional IVIarkov chains. Their methodology allowed them to show that 
U {j, k} is stable under Best Fit for several specific pairs of values for j and k. Kenyon et al. [11] expanded 
on this work by proving that Best Fit is stable under the entire family of distributions U{k — 2, k}, using a 
complex analysis of the underlying Markov chains. 
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We briefly describe the Markov chain setting used in the results described above. Using the Best Fit al- 
gorithm under a discrete uniform distribution, a packing can be represented by the number of bins of each 
possible residual capacity. The order of the bins is irrelevant. This packing process can therefore be easily 
represented by a Markov chain, where the state at any time is a vector s — (si, Sk-i), and Sj is the 
number of bins of residual capacity i/k. 

The Best Fit algorithm is well suited to the Markov chain approach, because the order of the bins is irrelevant, 
leading to a simple representation of the packing. In contrast, in the First Fit algorithm, the order of the bins 
cannot be dismissed. Because of the difficulty of representing the state in the First Fit algorithm, until now 
these Markov chain techniques have not been successfully applied to the First Fit algorithm. 

In this paper, we remedy this problem by demonstrating a Markov chain argument that shows that First Fit 
is in fact stable under the family of distributions U[k — 2, k}. This result disproves a conjecture made by 
Coffman et al. [3], who state that limited experiments suggest that the expected waste may grow unbounded 
on U{k — 2, k} for sufficiently large k. Moreover, it demonstrates that the Markov chain approach may be 
more generally applicable than previously believed. 

Our proof emerges from an analysis of a new bin packing algorithm, called Random Fit (RF). Random Fit 
is a simple randomized variant of First Fit. With Random Fit, each time an item is to be placed in a bin the 
bins are indexed in an order determined by a permutation chosen independently and uniformly at random. 
Each item is sequentially placed into the lowest indexed bin into which it will fit, or into a empty bin if no 
such bin is available. 

In Section 2 we introduce Random Fit by analyzing its worst-case behavior. In the following sections we 
then concentrate on average-case analysis. Random Fit has the advantage that, like Best Fit, a packing can 
be represented by the number of bins of each possible residual capacity. Therefore, in Section 3, we first 
generalize the analysis of Best Fit shown in [11] to Random Fit. We prove stability of Random Fit under 
the input distribution U{k — 2, k} and derive some related results for U{k — 1 , k} and U {k, k}. Using ideas 
developed in Section 3, we proceed to prove stability of First Fit under input distribution U[k — 2, k} in 
Section 4. 



2 Worst-case analysis of Random Fit 

We compare the behavior of Random Fit with an optimal offline algorithm. Recall that with Random Fit, 
each time an item is to be placed in a bin the bins are indexed in an order determined by a permutation 
chosen independently and uniformly at random. Each item is sequentially placed into the lowest indexed 
bin into which it will fit, or into a empty bin if no such bin is available. 

Given a sequence S = (ai, a2, ■ ■ ■ , a„) of items and a bin packing algorithm A, let A(S) denote the number 
of bins used by A to pack S. In particular, OPT(5') is the number of bins used by an optimal offline algorithm, 
i.e., it is the minimum number of bins required to pack S. 

Theorem 1 a) For every sequence S, RFiS) < 2 ■ OPT(S) - 1. 

b) There exist sequences S, with arbitrarily large values of OPT(S), such that with high probability 
RF{S)^2- OPT{S)-l. 



2 



Proof: Part a) At any time, the sequence of bins used by RF contains at most one bin with residual capacity 
of at least ^. Thus, for any sequence 5, the number of bins used by OPT is at least \_^RF{S)\ + 1. 

Part b) For any integer n > 2, let S„ be a sequence that contains n large items of size 5. In addition, in 
between any two large items, small items each of size 2^ must be inserted. Thus 

^ _ ^1 1 111 111 11^ 

2' 2n^ ' ' 2n^ ' 2 ' 2n^ ' ' 2n^ ' 2' 2n^ ' ' 2n^ ' 2 

Note that the sum of all the small items is :^n^{n — 1) < ^. 

Clearly, OPT(5„) = L|J + 1- We show that with high probability Random Fit uses n bins on this sequence. 

More precisely, immediately before an insertion of a large item, the probability that a bin holding a large 
item does not contain a small item is bounded by (1 — < e^". Thus, the probability that at any of the 
n insertions of large items, some open bin having a large item does not contain a small item is bounded by 
n'^e~". We conclude that with probability at least 1 — pr, RF needs n bins to pack 5„. ■ 

While RF has a guaranteed worst-case performance, it does not achieve the same bounds as First Fit and 
Best Fit. In the worst case, RF is only as good as Next Fit and Worst Fit. 

Motivated by recent work [1, 15], we also consider an extension of Random Fit, called Random-Fit{d), that 
is defined for any integer d > 2. Whenever a new item arrives, RF(J) examines bins in the same way as 
RF until d bins are found that can hold the item. Among these d bins, the item is inserted into the bin with 
smallest residual capacity, i.e., the Best Fit rule is applied. If there are only /, / < d, open bins that can hold 
the item, then the item is inserted into one of these / bins, using again the Best Fit strategy. If none of the 
open bins can hold the item, then the item is inserted into a new bin. 

Interestingly, when making the transition from RF to RF(J), the worst-case performance improves. 
For any algorithm A, let 

= {r > 1| for some N > 0, A(S)/OPT(S) < r for all 5 with OPT(S) > N). 

Theorem 2 For every d > 2, R^p^^^ < {g. 

Proof: Follows from a result by Johnson [7, 8] because RF(d) belongs to the class of Almost Any Fit 
algorithms. ■ 

3 Average-case analysis of Random Fit 

In this section we prove that Random Fit is stable under the input distribution U{k — 2, k} and derive some 
related results for U[k — l,k} and U[k, k}. 

3.1 Preliminaries 

We begin by reviewing some important definitions and lemmas from [11]. For considering the distribution 
U[j, k], rather than have bins of size 1, we shall instead think of having bins of size k and item sizes chosen 
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uniformly from {\, . . . , j}. The two notions are clearly equivalent. We shall model the system using k — \ 
tokens that move on the non-negative integers. The value of token / at time t, denoted by Si{t) represents 
the number of bins with residual capacity / after t items have been placed. The state of the system at time 
t is given by a vector = (si(t), Sk-i(t)). Initially, s(0) — (0, . . . , 0), as there are no open bins with 
residual capacity. We shall often drop the explicit reference on t when the meaning is clear. The waste at 
time t is given by X!/=i (^)- v/ish to show that the expected waste as ? — ^ oo remains bounded. 

We shall divide the tokens into classes. The token i is called small if 1 < ? < [2! called large if 

L 2 + 2J < j < 7 • In the case where j is even, there is also a middle token, namely f^] + 1 . For convenience, 
we shall temporarily restrict ourselves to the case where j is odd, as the case where j is even requires some 
additional work to handle the middle token. We shall explain the modifications necessary for the case where 
j is even after the proof of the case where j is odd. 

We begin with the following lemma: 

Lemma 3 State s is reachable from the initial state s(0) — (0, . . . , 0) only if 

1. For distinct indices i and i' with i + i' >k, either si —0 or s,' — 0. 
2- Xl; not small — ^ 

Proof: By induction; it follows from the fact that we will not open a new bin if an item can be packed in a 
current bin. ■ 

It is also not hard to see that all states that satisfy the conditions of Lemma 3 are reachable, and hence we 
assume hereafter that our state space consists exclusively of all states satisfying the conditions of Lemma 3. 

From Lemma 3, if s^i^ (t) > 0, then all large tokens must be 0 at time t. Our proof of stability will rely on 

2 

this simple feature of the chain. In particular, this feature allows us to focus on the behavior of the small 
tokens, which is considered in the following lemma: 

Lemma 4 Using Random Fit, the motion of a small token i has the following properties: 

1. For i > 1, the motion of si at all positions other than 0 is a random walk on Z+, such that a positive 
step is taken with probability at least j and a negative step is taken with probability at most j + ^ ''Y,. . 

2. The time spent by Si on each visit to 0 is stochastically dominated by a random variable D with 
constant expectation and variance ( that depend only on j). 

Proof: For the first part, note that, if Si > 0, then .v, increases whenever an element of size k — i enters the 
system, by Lemma 3. Hence we need only consider negative steps. If an item of size / enters, then Si may 
decrease; if an item of size less than / enters, then it is clear that the probability of it landing in a bin of 
capacity / it at most — The result follows. 

The second part is almost exactly the same as in Proposition 4 of [1 1], which we sketch here for complete- 
ness. If Si — 0, and Si' — 0 for all i' > k — i, then clearly s, moves to 1 with probability at least l/j . If 
j,v — I for some i' >k — i, however, this is not the case. It suffices to note that if two consecutive items have 
size k — i, then Sj will go to 1 even in this case. One may check that this fact suffices to prove the lemma. ■ 
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3.2 Outline of the proof 



We now sketch how we will prove that RF is stable, following the same approach as [11]. We first note that 
by Lemma 3, the amount of waste from non-small tokens is bounded by a constant. Hence we need only 
consider the waste due to small tokens, which we denote by f(t) — Yll=i^ (^)- 

The proof breaks down into three steps. For the first step, we show that if Sri-,{t) > 0, then the expected 
change in f{t), or E[/(f + 1) — f(,t)\f(t)], is negative. For the second step, we show that if we begin a 
state where f(t) is large, then for some suitably large T, for almost all of the next T steps Sri-. > 0 with 
a suitably high probability. Combining these two steps, we find that, whenever f (t) is sufficiently large, 
the expected change in f{t) is negative over a suitably long interval T. The third step is to this fact and 
results from the general theory of Markov chains that to show that we may conclude that the expected waste 
is bounded. 

The challenging part of the proof is the second step, where we must show that^^ > 0 for most of a suitably 
large interval. The first step is actually a simple lemma, entirely similar to one given in [1 1]. However, since 
the lemma is heavily based on the fact that j — k — 2,v/e present a proof here. 



Lemma 5 ([11], Proposition 5) Suppose that s r lAt) > 0. Then E[f(t + 1) - f(t)\f(t)] — -l/j. 



Proof: Consider the size i of the item inserted at time t + I . If \ < i < I j /I] , then the new item is assigned 
to a bin with remaining capacity I, i < I < \j/2'\, and / decreases by /. If f^] < / < j , then, since 
s\j/2-\ > 0, Proposition 3 implies that there is no bin with remaining capacity /. Thus, the incoming item is 
put into a new bin, i.e., s^-i increases by 1 and / increases hy k — i. The expected change in / is therefore 

1 /ri/21 j \ 1 /ri/21 ri/21 \ 

J \i=i /=r;721+i / ■' \i=l i'=2 I 

because k — j — k — (k — 2) — 2 and, since j is odd, k — i\ j /2'] + I) — \j/2']. It is easy to verify that 
equation ( I ) evaluates to — I /j . ■ 

The third step relies on general conditions for a multi-dimensional Markov chain to be ergodic; we cite the 
appropriate lemma from [II], which is derived from [5]. 

Lemma 6 ([11], Lemma 6, or [5], Corollary 7.1.3) Let M be an irreducible, aperiodic Markov chain with 
state space S c Z*^, and b a positive integer. Denote by p^^, the transition probability from s to s' in M^, 
the b-step version of M. Let $ : 5 — ^ R+ be a non-negative real-valued function on S which satisfies the 
following conditions: 

L There are constants Ci, /jl > 0 such that $ (5) > Ci | |j 1 1 for all s e S. 

2. There is a constant C2 > 0 such that p^^, — 0 whenever \<t>{s) — <t>{s')\ > C2, for all s, s' G 5. 

3. There is a finite set B d S and a constant e > 0 such that "^^'es Pss'^^^'^'^ ~ ^i^)) < ~^ for all 
s e S\B. 
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Then M is ergodic with stationary distribution n satisfying n{s) < Ce ^*^^^ for all s e S, where C and S 
are positive constants. 

For the bin-packing problem, we shall use = ^jly isi + k — I = f + k — I, where / is the waste 
from small tokens. This is an upper bound on the total waste. One may check that the first two conditions 
of Lemma 6 are satisfied for any choice of b. It remains to find appropriate b, B, and e; this is equivalent to 
the second step of our proof sketch, which we now focus on. 

3.3 Random Fit over long intervals 

We now show that, for all but a finite number of starting states, s^i-^ > 0 for most of sufficiently large 
intervals. We shall often compare the behavior of a token with a random walk over an interval [0, R]. We 
shall use p-fii) to denote the probability that a walk at / moves to / + 1 in one step. Similarly p]^(i) is 
the probability that a walk at / moves to / — 1 in one step, and p^ = 1 — pf (/) — p^ii) (the self-loop 
probability) is the probability that the walk remains at i when at i . We shall drop the i in cases where p^ (?) 
is independent of / (except at 0 and R, as ^4,(0) and P'[(R) are necessarily 0, and the self-loop probabilities 
are increased accordingly); this is called the homogeneous case. A random walk is downward biased if 
Pfii) < Pi(i) for all / in the range of the walk (except the boundaries). 

In order to bound the behavior of the random walks we study, we shall require the following lemma, which 
is a weak bound derived from Corollary 4.2 of [12]: 

Lemma 7 Let A,i < 1 denote the second largest eigenvalue of the transition matrix for a random walk W 
on [0, R]. Let n{A) — XlasA be the stationary probability that the walk lies in A c R, and Wi(A) be the 
number of steps the walk spends in A during the first I time steps. If the walk starts at 0, then for any integer 
I > I and! < P < l/n(A), 



To use the above lemma we will require the following fact about the eigenvalues: 
Lemma 8 For the random walk on [0, R] with p^ — Pi — a, < I — 

We start with a preliminary lemma that provides both the first step and the main idea of the proof. In this 
lemma, and all that follows, we assume that T is at least as large as some constant chosen so that the bounds 
hold. 

Lemma 9 For sufficiently large T, if Si > over the time interval [0, T], then Si+i > T^l^^ for all but at 
most r 15/16 gfgpg y^;iffi probability at least I — 

Proof: By Lemma 4, the behavior of the token Si+i at any point on the interval [0, T] can be related to 
a random walk over the positive integers, where p^(i) > l/j and p],(i) < j + ^ +1 i (except at i — 0). 
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Furthermore, the probabiUty that > T^/^^ for all but at most r'^/'^ steps, which we shall hereafter call 
z, is clearly minimized if we start SiJ^\ at 0. This information is sufficient to prove that z > ^ directly; 
however, we suggest an easier approach. 

We first note that, since we are comparing the behavior of i'l+i to a specific random walk, z can only increase 
if we restrict the walk (or, equivalently, the token Si+\) to the interval [0, T^/^ — 1]. Bounding the walk in 
this way will simplify the analysis. Also, for convenience, we also temporarily ignore the problem of the 
waiting time when Si+\ = 0 as described in Lemma 6. 

We now split each step, or item arrival, into two phases. In phase one, a random permutation order is chosen 
for the open bins. In phase two, an item size is chosen from the distribution U{j, k], and this item is placed 
according to the RF rule. 

By breaking each step up in this maimer, we see that whenever the permutation chosen in phase one has a 
bin with remaining capacity / ahead of all bins of remaining capacity / + 1, then for phase two, the worst 
possible case is that Si+i behaves Uke an unbiased random walk, with — p]^ — (Note that it is 
possible that < but we maximize the time that Sj+i > T^l'^^ by assuming that p| = In the 
alternate case where a bin with remaining capacity i + 1 lies ahead of all bins of capacity i in phase one, we 
may again overestimate z by assuming that = 0 and = \ m phase two. As we now show, by splitting 
each step into two phases in this way, we have essentially reduced the problem to an unbiased walk. 

We note that, over the interval [0, T] we have enforced the restrictions .v,+i < T^/^ and Si > T^. Hence, 
with probability at least ^ , for no steps in this interval do we place a bin of capacity / + 1 ahead of all 
bins of capacity / in phase one. We call this event £. Conditioned on £, Si+\ behaves like an unbiased 
random walk on [0, T^/^ — 1] over the entire interval. In particular, the stationary distribution is uniform, so 
71, = r~^/^ for all /. Let Z be the number of steps for which Si+\ < T^l'^^, From Lemmas 7 and 8, we find 
that for sufficiently large T, 

Pr[Z > r^^/i^ I < T^'^ ■ r^/^exp(^ — j (2) 



Using a union bound on probabilities now yields the lemma. 

To handle the discrepancy when the walk is at 0, we note that we can explicitly bound the total number of 
steps at 0 with sufficiently high probability using part 2 of Lemma 4. The bounds given by equations (2) 
and (3) can also be tightened so that for sufficiently large T, the lemma as stated holds. ■ 

We have shown that if is extremely large over a sufficiently long interval, then is also be large over 

most of the interval with high probability. Our actual goal is to show that if any .v,- is extremely large (for 
i < [2!)' then s^i^ > 0 over most of the interval. Hence we will require an inductive, but slightly weaker, 
version of Lemma 9. 

One problem in generalizing Lemma 9 is that if Si is large only for most, and not all, of the steps, then 
there are several steps where we cannot explicitly say how Si+\ behaves. Moreover, these steps may affect 
the behavior of at any point. We avoid the problem by introducing an adversary model, generalizing a 
similar argument from [11]. This adversary model allows us to consider the worst possible case for the steps 
where Si is smaller than we need. 
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We consider how an adversary can affect a homogeneous downward biased random walk on [0, R]. The 
goal of the adversary is to keep the random walk at or below some level I, I > 2, for as many steps as 
possible. The adversary may control a fixed number of steps. In a controlled step, the adversary may specify 
any probability distribution on the legal moves from the current state; the step of the walk is then made 
according to that distribution. In all the other steps, the process behaves like a homogeneous downward 
biased random walk. 

In the following, given an adversary strategy A, let pA(y,i,n,m, I) denote the probabihty that a homoge- 
neous downward biased random walk of n steps on the interval [0, R] starting at i with y controlled steps 
used according to A, spends at least m steps at or below I. 

Lemma 10 For all non-negative integers y, i,n,m and I, with I < R and i < R — l, the exists an adversary 
strategy Aq 

(a) that never uses a controlled step when the walk is below I 

(b) that always uses a controlled step as soon as possible when the walk is at or above I + \ to push the 
walk downwards 

such that PAo(y, i,n,m,l) > pAiy,i,n,m, I) for all adversaries A. 

Proof: The case where / = 0, the walk is unbiased, and the self-loop probability is 0 corresponds to what 
is proven in [11, Lemma 7]; we extend the argument to this more general case. We use induction on n. We 
first note that any adversary that uses a downward move when the walk is below I can be replaced by one 
that does not. This follows by a simple coupling argument. Compare the strategy where the adversary uses 
a downward move below / to one where the adversary waits until the walk is at / by coupling all random 
moves; the second strategy will be at the same height or below the first after the downward move. (It will 
end up below only if the walk reaches 0.) Thus we have shown that there is an optimal adversary strategy 
that satisfies condition (a). 

We now concentrate on adversary strategies that use their moves at or above / + 1 . Let R denote the 
strategy Ai which uses the y adversary -controlled steps as soon as possible when the walk is at or above 
/ -I- 1, and then follows the random walk. Let RD^ denote the strategy A2 that begins with a random step, 
and then uses the adversary-controlled steps as soon as possible when the walk is at or above / -I- 1. Let 
Pa^ (y , i, n, m, I) be the probability of the event that the walk is at or below I for at least m of the next n 
steps after starting at / when adversary strategy Ai — D^R is used. Similarly, let PA2iyy i,n,m,l) be the 
probability of the event that the walk is at or below / for at least m of the next n steps after starting at i when 
adversary strategy A2 — RD^. We claim 

PAi{y,i,n,m,l) > pAAy,i,n,m,l), (4) 

and by induction this suffices to prove that there is an optimal strategy satisfying condition (b). 

We first present two useful propositions. 

Proposition 11 pA^ {y, I, n, m, I) > pAi {y, l,n,m+ 1,1) 
Proposition 12 p^i (y,l — l,n,m,l) > pA^ {y + \ ,l,n + \ ,m + \ ,l) 
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Proposition 1 1 is easy to verify. We prove Proposition 12. Let be the walk that starts at / — 1 and follows 
strategy R; similarly let W/ be the walk that starts at / and follows strategy D*+' R. Let r/_i be the time 
when Wi-\ first makes the transition (/ — !)—>/ and let 7) be the time when Wi first makes the transition 
/ ^ (/ + 1). Clearly, r/_i — Ti in distribution. We only have to consider the event that r/_i — Ti < n + I 
and r/_i = Ti >m. Then, the remainder of is a walk starting at I that follows strategy R and must 
be at or below / for at least m — r/_i of the next n — Ti^i steps. In the case of Wi, the adversary first pushes 
the walk down to I and the remainder is also a walk that starts at I, follows strategy D^R and must be at or 
below / for at least m + 1 — T/ —m + l — r/_i of the next n + 1 — (r/ + l) — n — Ti steps. Using Proposition 1 1 
and taking again into account that r/_i = Ti in distribution, we conclude the probability of the first walk is 
not smaller than that of the second walk, i.e., pAi (y,l — \,n,m,l) > pA^ (j + 1 , /, n + 1 , m + 1 , /). 

We return to the proof of inequality (4). If j <l, both strategies A\ and A2 start the same and we are done 
by induction. If / > y + 1, both strategies give the same distribution after >' + 1 steps, so the two quantities 
PAi {y,i,n,m,l) and PA2{y^ i,n,m,l) are equal. The interesting case is when / < / < y + In this case, 
strategy Ai forces the walk from i down to / using / — / controlled steps. Thus, 

PAiiy,i,n,m,l) - pAi(y',l,n',m - 1,1), 

where n' — n — i + 1 and y' — y — i + 1. Also 

PAiiy, h n, m, I) = p^ ■ PAiiy' - 1, /, «' -2, m - 1, /) + p| • pAiiy' + 1, 1, n',m - 1, /) 
+ p^ ■ pAiiy', l,n' - l,m- 1, 1) 

and 

PAi(y',l,n',m -1,1) - Pi- PAiiy' -l,l,n' -2,m- 2,1) + pi ■ pAii.y',1- \,n' -\,m- 2,1) 

+ p^ ■ pAi (y', l,n' - \,m-2, 1). 

Using Proposition 11, we have pAiiy' — l,l,n' — 2,m — 2, 1) > pAiiy' — 1, /, — 2, m — 1, 1) and 
PAi(y',l,n' - \,m-2,l)> pAi(y',l,n' -\,m- \,l). Thus, 

PAiiy, i,n,m, I) - PAiiy, i,n,m, I) > p^ipAiiy', I - l,n' - \,m - 2,1) - pAiiy' + 1, 1, n',m - 1, /)). 
Proposition 12 implies that the last term in non-negative. ■ 

Lemma 13 Suppose, over a period of T steps, .v,_i > T" over all but T^~" steps for some a < 1/16. Then 
Si > T"/^^ for all but at most ji-^/i^ steps with probability at least 1 — 3T~"^^. 

Proof: As in Lemma 9, we may, without loss of generality, restrict Si to the interval [0, T"/'^ — 1]. Then Si 
behaves like a slightly biased random walk on all but the T^~" steps for which lies below T". Rather 
than consider the biased walk, however, we use the same technique as in Lemma 9 to reduce the problem to 
an unbiased random walk by splitting each step into two phases. We give the adversary control on all steps 
in which a bin with remaining capacity / lies ahead of all bins with capacity / — 1 after the first phase. On 
any step for which Si-i > T" and 5,- < r"/^, the probability that a bin with remaining capacity i Ues ahead 
of all bins with capacity / — 1 after the first phase is at most -j^. Hence, the expected number of such steps 
is at most 7'i-3«/4^ Markov's inequality, the number of such steps is at most T^~" with probability 

at least j^"/'^. Let £ be the event that there are no more than T^~" such steps. 
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Conditioned on £, the adversary controls at most 2r^~" steps: r^~" from the above paragraph, and T^~" 
from the steps where Si^\ < T". On all other steps the walk behaves like an unbiased random walk with 
Pf = Pi = ^/j ■ (Again, this is not quite true when Si = 0, but this small discrepancy can be easily handled 
explicitly as described in Lemma 9; for convenience we dismiss the problem here.) We use this to bound 
the probability that Si lies below r^/i^ for more than ji-^/i^ steps. 

We first consider the moves controlled by the adversary. In the worst case, Si begins at 0. By Lemma 10, 
there exists an optimal adversary strategy Aq that uses a controlled step whenever Sj reaches T"/^^ — 1 or 
jjence, to overestimate the effect of the adversary, we assume the following: the adversary uses its 
moves whenever Si reaches T"^^^; the adversary's move returns the walk to Sj — 0; and all steps until the 
adversary's moves are used count as steps where e [0, T"^^^ — 1]. These assumptions can only increase 
the time until the adversary's moves are used. The expected time for to reach from 0 is cT"/^ 
for some constant c. Thus the expected number of steps until A has used all of its moves it bounded by 
^ji-7o!/8 2j be the number of steps until the Aq uses all of its moves. Then by Markov's inequality 



Pr 



yl — a/16 
> — 



for sufficiently large T. 



After the adversary steps are used, the number of steps that 5, spends in the interval / = [0, r^/i^ — 1] is 
stochastically dominated by that of an unbiased random walk U on [0, T"^'^] that runs for T steps and begins 
at 0. Let Z2 be the number of steps U spends in /. As in the proof of Lemma 9, the equilibrium distribution 
of U is uniform over [0, T"^"^ — 1]. Thus n{I) = j^^a/ie Using Lemmas 7 and 8 we obtain 



Pr 



for sufficiently large T. 



yl— ff/16' 
Z2>—: 



< 



ya/8 . ya/8 / y^— 3a/8 . y— a/2 _ ' 

- exp 



2 

< j-tt/4 



j^—ia/a . y— a/2 _ 



Taking a union bound, we find that the probability that Z\ + Z2 > "^^^ is at least 1 — ST which 
proves the lemma. ■ 

We are now ready to prove the main theorem: 



Theorem 14 Random Fit is stable under the distribution U{k — 2, k} for all k >3. 



Proof: As in our previous calculations we first assume that k is odd. As in Theorem 1 of [11], it suffices 
to consider the drift of /(*) over a suitably large interval T, and show that it is negative for all but a finite 
number of states. The excluded set of states G will be 

G^[s eS: Vj, si < T^}, 

where T will be determined. Consider any starting state outside of this set G. Applying Lemma 9 and then 
Lemma 13 inductively, we find that with probability at least 1 — (ci/r^'), Sri-, > 0 over all but of the 
steps, for some constants ci and ei, 62 < 1 dependent only on j. Let A be the event that s^i-^ > 0 over all 
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but Qf steps. As the expected value of / decreases by \/j whenever s^i-^ > 0 by Lemma 5, and it 
increases by at most j otherwise, 



E[/(r) - /(0)|/(0)] < E[/(r) - /(0)|/(0) A^l] + (l -PrU]) E[/(r) - /(0)|/(0) a -.yl](5) 



By choosing T sufficiently large, we may make this expression smaller than —5 for some constant 5. This 
suffices to prove the theorem, by Lemma 6. 

If k is even, then there is middle token s\ji2-\+\. If s\j/2-\+\ — 0, everything is exactly as in the case where 
k is odd. If s\j/2-]+i > 0> then by Lemma 3 s\j/2-]+i — 1 and no bins with larger capacity are open. We 
consider the time steps when Sfj/2-]+i = 1- In these steps / might increase because a small item may be 
inserted in the bin of capacity [7/21 + 1. Lemmas 9 and 13, which apply when k is even, give that with 
probability at least 1 — {c\/T^^), SrH > T^~^^ over all but T^^ of the steps, for some constants c\ and 
e\,€2 < 1 dependent only on j . Hence it should be a very rare event for a small item to be placed into a bin 
of capacity Ij/l] + I. 

In fact, in exactly the same manner as shown in Lemma 5, one may show the following: 

Proposition 15 Suppose thatk is even ands\ji2-\ > Z. Then E[f (t + 1) — f(t)\f{t)] < —l/j + 2/Z. 

We conclude that in this case 



E[/(r) - /(0)|/(0)] < E[/(r) - /(0)|/(0) a yl] + (l - Pr^J) E[/(r) - /(0)|/(0) A ^AKD 



One may check that from the inductive use of Lemma 13, the 62 in Theorem 14 is exponential in j, and 
hence our bounds on the expected waste is doubly exponential in j . It is an interesting question whether 
better bounds are possible. 

It is also worthwhile to note the following: 

Theorem 16 Random Fit{d) for d >2is stable under the distribution U{k — 2, k} for all k >3. 

The proof is entirely similar to that for Random Fit. Simulations suggest that as d increases, the behavior of 
Random Fit(d) rapidly approaches that of Best Fit, as one might expect. 

Theorem 17 Random Fit and Random Fit(d), for d >2, have expected waste o{n) under the distributions 
U{k — l,k} and U {k, k}, for all k >3. 

Proof: We only consider the distribution U[k — l,k}, as the waste under the distribution ?7{^, k} is entirely 

similar. Under this distribution, the statement corresponding to Lemma 5 is that if s^i-. (t) > 0, then E[f(t + 

1 2 1 

1) — f(t)\f(t)] — 0. Using the same notation as in the proof of Theorem 14 we obtain 



< 



-- {T - T'^) + jT'^ + ciT^-^i j. 



(6) 




(8) 



This expression can also be bounded by —5 if T is chosen large enough. 



E[/(r) - /(0)|/(0)] < jT'^ + ciT'-'^j 
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for some constants ci and ei , 62 < 1 dependent only on j . Hence, once the expected waste reaches a certain 
constant, its expected growth is sublinear, proving the theorem. ■ 



Whether tighter bounds, more like those known for Best Fit and First Fit, are possible for Random Fit under 
these distributions remains an open question. 

4 Analysis of First Fit under distribution U{k — 2, k} 

We now consider how to modify the proof of RF on the distribution U [k — 2, k} to work for First Fit. Again 
we focus on the case where k is odd; the case where k is even requires some minor additional work, as for 
Random Fit, which we omit here. 

One way of thinking about the difficulty in extending the results from RF to FF is to consider the dependence 
among the steps. In RF, at each step we have an independent random ordering assigned to the bins, while 
in FF, the orders of the bins at different steps are clearly dependent. In particular, the order of the bins at 
each step depends on the initial state, over which we have negligible control. The work of this section will 
focus on finding ways to circumvent effect of these dependencies so that we can apply the same ideas that 
we used in Section 3. 

Let us consider an initial state, given at time t — 0. In order to avoid problems caused by the order of bins 
in the initial state, we focus on bins that are created after time 0. In fact, we are even more restrictive: let a 
single i bin at time t be a bin created after time 0 that has remaining capacity / and contains only one item, 
and denote the number of single i bins by Ui{t). Instead of the vector s we considered previously, we shall 
primarily the vector u — {u\, . . . ,u.i-.). The following important points about u make it useful: 

I 2 I 

• If > 0, then > 0 also. Hence, proving M|-ii > 0 over most of the steps is sufficient. 

• Regardless of the initial state, (mi, . . . , Wrji) = (0, . . . , 0) at time 0. 

I 2 I 

To see how the considering u makes things easier, let us prove a lemma similar to Lemma 9 for First Fit. 

Lemma 18 Suppose Si(G) > T. Then when m;+i > 0, m/+i behaves like a random walk with probability 
at least l/j of increasing at each step and probability at most l/j of decreasing at each step. Also, the 
time spent by Wj+i on each visit to 0 is stochastically dominated by a random variable D with constant 
expectation (that depends only on j). In particular, ui+i > T^l^^ for all but at most T^^l^^ steps with 
probability at least 1 — 

Proof: Since 5, (0) > T, over the next T steps there is always a bin with remaining capacity i ahead of all 
single bins with remaining capacity / + 1 created after time 0. This implies that m,+i can decrease only when 
an item of size / + 1 arrives, and hence decreases with probability at most \ /j at each step. When Wj+i > 0, 
then M,+i increases whenever an item of size k — i — \ arrives, and hence it increases with probability at least 
1/j . The case where m,+i = 0 is special, and is handled as in Lemma 4. The final result, that m;+i > r i/i^ 
most of the time, now follows using an argument similar to Lemma 9. ■ 
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As in the proof for RF, we now want to extend the above lemma inductively. Similar to the RF case, we 
would like to say that a bin of size / lies ahead of all single / + 1 bins most of the time, whenever the number 
of single / + 1 bins is sufficiently small. In Lemma 13, we accomplished this by splitting each step into two 
substeps, with the first substep re-ordering the bins randomly. We do not have this luxury for the FF case. 
However, it seems intuitive that the bins should be "almost" randomly distributed at each step. This point is 
made explicit in the following lemma: 

Lemma 19 Let £ be the event that a single i bin at time t lies ahead of all single i + 1 bins. Let z^''^ — 
Pr{£\uiit) = b, Ui+iit) = c}. Thenz';'' < ^. 

Proof: Consider any sequence a — ai,a2, ... ,at of t items that ends with a single / + 1 bin ahead of all 
single i bins with m,- (t) — b and t<;+i {t) — c. We center on the steps where the single i and i + 1 bins were 
created. We first claim that if a single / bin was created at step g and a single / + 1 bin was created at step 
h, then switching the entering items at steps g and h switches the order of these two bins, but has no other 
effect on the algorithm. This can easily be proven by induction for all bins behind the first single / + 1 bin, 
since there is no way a second item could have been placed in any of these bins. The only difficult case is 
that of the first single / + 1 bin, call it B. The reason that B is a special case is that it is possible that since 
B is the frontmost single bin, it may be that a second item could have been placed in it if we change its 
capacity. However, since switching the appropriate steps g and h would only lower the capacity of S, it is 
clear that if B has not obtained a second item in the original sequence, it cannot in the modified sequence as 
well. 

We now divide the sequences into equivalence classes. For a sequence a, let 7/ (a) be the set of times at 
which the single / bins at time t were created. Two sequences a and a' are equivalent if 7/ (a) U 7/+^ (a) = 
7/ (a') U 7/"*"^ (a') and Ui(t) — b, m,+i(?) — c for both sequences. 

Take any sequence a with a single / + 1 bin ahead of all single i bins at time t. From the above paragraph, 
permuting the times when a single / + 1 bin and a single / bin were created yields equivalent sequences. 
Hence, by taking all ways of splitting 7/ (a) U 7/"'"\a) into two groups of size b and c, and using this 
division to determine when single i and i + 1 bins are created, we find that every sequence a has at least 
(^^'^) sequences in its equivalence class. Since the probability a and any of these other (^+^) sequences 
occurring are equal, it is straightforward to show combinatorially that there are at least b/c times as many 
sequences with a single / bin ahead of all single / + 1 bins as there are with a single / + 1 bin ahead of all 
single i bin. Hence zf'"^ < ■ 

Lemma 19 suggests that the behavior of FF should not be worse than RF, with the understanding that the 
Ui now play the role of the 5, . As in the case of RF, we would like to say the small tokens behave Hke 
a unbiased random walk over most of the steps. This leads us to the prove a variant of Lemma 13 in this 
setting, which is phrased slightly differently in order to appropriately handle the conditioning. 

Lemma 20 Suppose, over a period of T steps, Ui^i > T" over all but at most T^^" steps for some a < 1/16 
with probability at least 1 /2. Then, conditioned on Ui-i > T" over all but at most T^^"^ steps, Ui > T"l^^ 
for all but at most T^~"/^^ steps with probability at least 1 — 4T~°'^'^. 

Proof: As in Lemma 13, we must bound the number of steps for which the behavior of m, is not that of 
an unbiased random walk, and then apply an adversary argument. Also as in Lemma 13, we will restrict 
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our consideration to the behavior of m, to the interval [0, T"/^ — 1]- (This can be interpreted as though 
if Ui > T"/^, we may assume that a single bin of size i + 1 hes ahead of all bins of size i, which is a 
conservative assumption.) 

To bound the number of steps the adversary controls, then, we bound the number of steps X that satisfy the 
following conditions: 

• Ui < - 1. 

• A single i bin hes ahead of all single i — 1 bins. 

The value of X, in addition to the number of steps for which m,_i < T", bounds the number of steps where 
the adversary controls the walk; on all other steps, we either have that > T"!'^ or a single i — 1 bin lies 
in front of all single / bins, and so m, behaves (at worst) as an unbiased random walk with p-^ — — I /j . 
(As usual, we ignore the discrepancy at Uj — 0.) 

Let yt be the probability that on the tih step the above conditions hold. Then 

r-i T-i 



t=0 t=0 



< 



^ ^ Ta _i_ fa/A 
t=0 ^ 



< T 



l-3a/4 



Although it would seem this is enough to bound the number of adversary steps, we must be careful. Let S 
be the event that > T" over all but T^~" steps. The expected number of additional adversary steps 
from single / — 1 bins being frontmost is not E[X], but E[Z|^^]. From the hypothesis of the lemma that 
Pr(^) > 1/2, however, we must have E[X|^^] < 2T^~^°'^^. Using Markov's law, we have 

Pr({Z|^} > T^-") < 27-"!'^. 

Hence, conditioned on £, the number of steps the adversary controls is at most 2T^~" with a probability at 
least 1 — 2T~"-I^. The rest of the proof now proceeds as in Lemma 13. ■ 

We are now ready to prove the main theorem: 

Theorem 21 First Fit is stable under the distribution U[k — 2, k} for all k >3. 

Proof: As in Theorem 14, it suffices to consider the drift of f{s) over a suitably large interval T, and show 
that it is negative for all but a finite number of states. The excluded set of states G will be 

G^{s eS: yi,si < T], 

for some suitably large T. We now apply Lemma 18 and Lemma 20 to obtain a bound on E[/(r) — 
/(O) 1/(0)] similar to that in Theorem 14. 
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We would then like to apply Lemma 6; however, technically we cannot do so, as the state space of the 
underlying Markov chain is not embedded in a fixed dimensional space. Similar results, however, can be 
applied in this setting, once we have shown that the expected change in the waste / is negative for a suitably 
large T. For example, [14, Theorem 13.0.1] can be used to show that the chain is ergodic, and [6, Theorem 
3.1] implies that in the stationary distribution, the distribution of the waste has an exponentially decreasing 
tail. ■ 



5 Conclusions 



We have demonstrated that the First Fit bin packing algorithm is stable on the distribution JJ{k — 2,k}. We 
believe that our result demonstrates that the Markov chain approach may be useful, even in situations where 
the natural description of a problem does not have a convenient state space. Our analysis made use of insight 
gained from a novel packing algorithm. Random Fit, which appears interesting in its own right. 

An open question is to tighten the bounds developed in this paper. For both First Fit and Random Fit, our 
bounds for the expected waste are doubly exponential in j . Simulations suggest that the expected waste for 
First Fit may only be exponential in j [9]. Unfortunately, the simulations for Random Fit seem to suggest 
that the expected waste for Random Fit may indeed be doubly exponential in j, in which case it seems that 
another approach may be necessary to achieve better bounds for First Fit. 
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